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A  Cost  Estimator’s  View  of  Reality 
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CARD  Contents 

System  Overview 


Unclassified 


•  System  Description  -  mission,  key  performance 
parameters,  relationship  to  other  systems,  picture  or 
diagrams  with  major  parts  and  subsystems  identified. 

•  Characteristics  -  technical  description  of  hardware  and 
software,  discussion  should  follow  the  elements  in  the  WBS 

•  Quality  Factors  -  operational  availability,  reliability, 
availability  and  maintainability  requirements 

•  Reference  Systems  -  describe  currently  operational  system 
or/and  systems  with  similar  mission,  discuss  how  this 
system  is  different. 
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Parametric  Estimating 
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•PROBLEM:  Estimate  cost  of  a  new  item 

*  SOLUTION:  Scale  and  adjust  actual  costs  for 
similar  items 

*  Parameters  scale  costs  to  technical  content 

Memory  HD  Capacity  I/O  Speed 

Power  Video  Memory  Processing  Speed 

*  Other  adjustments  account  for  temporal  changes 

Inflation  Technology  Advancement 


1  OSDCAIG  '  J 


i  ~ 

Unclassified 


Cost  Growth  Study.PPT  MBD  05/30/2001  9:39 


Unclassified 


A  Parametric  Example 

Beam  Steering  Assembly  of  a  Radar  Seeker 


•  Data  base: 

-AMRAAM  (Hughes)  -Phoenix  A  -Phoenix  C 

-AMRAAM  (Raytheon)  -Longbow  -Patriot 

-Sparrow-M  -MLRS-TGW  -Other  Systems 

•  Cost-estimating  relationship  (first  unit  production  cost) 

Cost  =  0.007  *  Antdia0  46  *  Channels0  87  *  Axes1 64  *  Error  term 

Antdia  =  Antenna  diameter,  cm 

Channels  =  Number  of  RF  receive  channels 

Axes  =  Number  of  axes  of  articulation  in  gimbal 

•  Suppose:  Antdia=20  cm,  Channels=  10,  Axes=3 

•  Then:  Cost  =  0.361  (FY88  $M) 
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Cost  Estimating  Uncertainty 
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Current  Cost  Estimating  Techniques 


High  A 


Contractors  typically  use  engineering  build-ups 
Program  office  methods  vary 
CAIG/CCA  use  parametric  models 


Contractors  use  build-ups  and  vendor  quotes 
PM’s  typically  use  Dem/Val  actuals  and  build-ups 
CAIG/CCA  use  parametrics  and  actuals 


Low 


Contractors  use  build-ups,  quotes,  actuals 
CAIG/CCA/PM  use  EMD  actuals 


- t 

Concept  &  Tech.  Dev.  Sys.  Dev.  &  Dem.  Production 

Program  phases 
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Cost  Growth  Study 


Unclassified 


•  Data  taken  from  SARs  up  through  Dec  1998 

*  Study  compares  final  cost  to  MS  II  estimate 


•  Quantity  normalized  estimate  at  EMD  approval  (i.e., 
MS  II)  is  baseline 


•  Percent  cost  growth  metric  is: 


CurrentEstimate  .  \  ,  ,  , 

- 1  xl00% 

^BaselineEstimate  J 


•  Study  has  been  publicly  discussed,  but  not  yet 
released 


No  other  study  of  comparable  scope  that  employs  such  detailed  data 
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Study  Details 
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Universe 


SARs  Currently  Useable  143 

Excluded  95 

Data  Problems  (in  process)  1 3 

Early  EMD  13 

Total  264 


Sample  Data 
Sheet 


in  Our  Sample 
Analysis  in  Process 
SARs  Currently  Useable 


Results 


Total  Cost  Growth  Since  Milestone  II 


Cost  Growth 

RDT&E 

Procurement 

Total 

Arithmetic  Average 

52% 

26% 

32% 

Dollar  Weighted  Average 

27% 

15% 

17% 

Number  of  Systems 

125 

129 

131 
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Decisions  and  Mistakes  Cost  Growth 


131  Systems 


Mistakes 


Mistakes 

-  Production  assumption  and  estimation 
changes 

-  Engineering,  test,  and  development  changes 

-  ILS  changes,  and  spares  and  support 
changes  not  attributable  to  post-milestone  II 
discretionary  decisions 

-  Schedule  slips  attributable  to  technical 
problems 

-  Other  changes  not  attributable  to 
discretionary  changes 


Decisions 


0%  5%  10%  15% 

Percent  Cost  Growth 


Decisions 

-  Requirements,  configuration,  and  variant 
changes 

-  Schedule  changes,  and  acquisition  strategy 
changes  (e.g.,  mutiyear  procurement,  dual- 

—  sourcing),  and  management  initiatives 

-  ILS  changes,  and  spares  and  support 
changes 

-  External  program  factors  (FMS,  strikes,  etc.) 

-  Other  discretionary  changes 


Nearly  half  of  perceived  cost  growth  is  content  change 
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Percent  Cost  Growth 
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Mistakes  RDT&E  Cost  Growth 

RDTE  Decisions  and  Mistakes  Cost  Growth 

125  Systems 

25%  -t - 

20% - 

15% - - 

10% - - 

5% - - 

0  Mistake  Categoies 

Underestimated  engineering  effort  major  source  of  error 
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■  Other  Mistakes 

□  ILS  Factors;  Spares  &  Support 

■  Schedule  Slips/Management  Factors 

□  Engineering/Test/Development 

■  Production  Assumptions  &  Estimation 
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Mistakes  Procurement  Cost  Growth 


Procurement  Decisions  and  Mistakes  Cost  Growth 


129  Systems 

20%  i - 


£  15% 
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2  io% 
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£  5% 
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0) 

Q-  0% 


-5%  J - 

Mistake  Categoies 


□  Other  Mistakes 

□  ILS  Factors;  Spares  &  Support 

■  Schedule  Slips/Management  Factors 

□  Engineering/Test/Development 

□  Production  Assumptions  &  Estimation 


Major  source  of  error:  Too  optimistic  learning  curve  slopes 
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Number  of  Systems 
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Mistakes  Procurement  Cost  Growth 


129  Systems 
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“High”  Cost  Growth  Systems 

M-1,  AH-64,  Bradley,  Javelin,  GLCM, 
AWACS,  FMTV,  JSTARS,  C-17 
Stinger,  UH-60A,  T-45,  SADARM 


<=  -20%  -20%  to  - 1 0%  - 1 0%  to  0% 


5  to  10%  10%  to  20%  20%  to  30%  30%  to  40%  40%  to  50%  50%  to  60%  60%  to  70%  >70% 


Mistakes  Procurement  Cost  Growth 


Problem  is  “high”  cost  growth  systems,  not  the  average 
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Hypotheses  on  Causes  of  Cost  Growth 


•  Honest  professional  error 

-  Poor  data 

-  Wrong  technique 

-  Technical  assumptions 

•  Institutional  Imperatives 

-  “Camel’s  nose”  --  budget  strategy 

-  “Tension  on  the  reins”  -  contractor  management 

-  Requirement/resources  standoff 
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Mistakes  Procurement  Cost  Growth 

by  Commodity  Class 
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128  Systems 


10% 


0% 


■ 


Electronic  31  Missile  29  Aircraft  24  Ship  18  Munition  7  Vehicle  6  Helicopter  5  Space  6 
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Procurement  Cost  Growth 


by  Program  Size 


Do  services  budget  to  cost  for  large  programs  and  cost  to 

budget  for  smaller  ones? _ 
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Percent  Cost  Growth 
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Mistakes  Procurement  Cost  Growth 

for  Systems  Passing  MS  II  in  the  Fiscal  Year 


(7)(D(D(7)(D(D(T)(7)(T)(7)(7)(T)(7)(7) 

Fiscal  Year 
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Levers  for  Improvement 


•  Competition/Incentive  Contracting 

-  Dual  Sourcing 

-  Price  Commitment  Curve  (PCC) 


•  Acquisition  Policy  &  Budget  Policy/Mechanism 

-  Carlucci  Initiatives  #6  -  Budget  to  Most  Likely  Costs 

-  POM  CAIGs  -  Acquisition  Stability  Fund 

-  TRACE  -  SCA  and  M  Accounts 

-  Fully  Fund  PM’s  Estimate  -  Impoundment/Termination 


•  Independent  costing 

-  CAIG  creation  in  1972  -  Statute  enacted  in  1984 

-  IG  report  increased  size  in  1992 
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Mistakes  Cost  Growth 
in  Dual  Source  Programs 
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Missile 

Programs 

Dual  Source 

Non  Dual  Source 

Number  of  Programs 

6 

19 

Percent  EMD  Mistakes 

Cost  Growth 

7.4% 

29.4% 

Percent  Procurement 

Mistakes  Cost  Growth 

4.1% 

15.2% 

*  Dual  Source  Programs  include: 

-  AIM-9M  -  Hellfire 

-  AMRAAM  -  Peacekeeper 

-  HARM  -  Tomahawk 
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Cost  Growth  Histograms 


Before  1 980 
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